Project overview on multimodal XR-AI platform for tele-rehab and the reciprocal care coupling with health guidance

The purpose of this project is to mitigate and solve issues regarding health care services such as rehabilitation and specific health guidance while alleviating spatio-temporal, economic, and cognitive constraints by establishing remote technology foundation. There are four themes in this project titled “Multimodal XR-AI (XR powered by AI) platform development for tele-rehabilitation and the reciprocal care coupling with health guidance.” In theme #1, we have been developing MR3 (Multi-Modal Mixed Reality for Remote Rehab) devices consisting of Wear and Mannequin for supporting detailed assessments of customers’ physical functions and tactile interaction respectively. The central issue of theme #2 is to support intrinsic motivation for rehabilitation and exercise training through XR technologies as in virtual co-embodiment and hand redirection. In addition, we have also been investigating how to deal with one-to-many (a small number of providers) and zero-to-many (no providers) situations. Theme #3 has aimed on establishing AI technology foundation for creating, monitoring progress of, and updating tele-rehab programs mainly for the upper limb. Systems for always-on monitoring during daily life and work developed in theme #4 is expected to be served as a common foundation for various tele-healthcare services.</p